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THE EFFECTIVENESS OF VISIBLE RECORDED FEEDBACK RESPONSES 
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INDIVIDUALS AND GROUP STUDENT RESPONSE TO EACH QUESTION. THE 
EXPERIMENTAL APPLICATIONS IN DIFFERENT SCHOOLS WERE STAGGERED 
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BE EFFICIENT IN TERMS OF TIME. (JM) 
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I. Introduction 



Vocational Agriculture Science or Agriculture Science is a com- 
plex composite science course. For this reason, it is desirable 
to find ways in which maximum learning can be achieved with the 
most efficient use of teacher- time. Close examination of the Edex 
Communicator v/ith its system of feed-back caused me to form the 
hypotheses expressed as objectives of this investigation. There- 
fore, this study was made to determine the effectiveness of visible 
recorded feed-back responses in the teaching of scientific theory 
and principles to students of vocational agriculture. "Feed-back 
is the response of students to the instructor, 

A, Objectives 

1. To determine the value of using immediate group feed- 
back to the teacher when teaching vocational students on the early 
secondary level 

2. To determine if there is a difference in retention of 
learning between students in vocational agriculture when taught 
v/ith and without the feed-back machine 

3o To determine if feed-back meters make more efficient 
use of teaching time. 

II. Method 



The equipment used in this test was the Edex Communicator, 

The Communicator consisted of the main console, which the instruc- 
tor uses, amd the individual response units placed on the desk of 
each student. The main console has the following features: (1) A 

group of lights on the Deckmdicates the participation and response 
of each student to a particular question; (2) Four meters marked 
A, B, C, and D on the console indicate the percentage distribution 
of the class in relation to the four possible answers. For example, 
80% might answer A, 6% B, 11% C, and 3% D; (3) An accumu- 
lator which will keep the total score of each student for the day. 

It was anticipated that through the use of this equipment the teacher 
would be able to adjust his teaching presentation and methods 
according to class response and comprehension. 
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The project was carried out in four high schools in Solano 
County, California. The four schools were selected at random 
for teaching two units, Animal Physiology and Plant Cells, 
experimentally and as a con.^r^. The four Agricultural Science 
teachers from each school developed the lesson plans for the 
project. The four units that were taught covered fundamental 
principles of animal physiology, poultry production, plant cells, 
and production of barley. Scheduling of the Communicator and 
the lesson plans into the four high schools followed the develop- 
ment of the lesson plans. Table 1 is the scheduling plan used in 
the project. A staggered plan was used since only one Communi- 
cator was available. 
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The actual experiment used two (Animal Physiology and Plant 
Cells) of the four lesson plans. The other two units were used 
in reducing the Hawthorne effect. The students were told they 
were involved in a project but were not told which one of the four 
units was control or experimental. The two units that were in- 
cluded in the experiment v/ere taught in the pattern as outlined 
on Table 1. As indicated on Table 1, two schools taught the 
Plant Cells unit for one week using the traditional method of 
instruction (control) followed by the unit on Animal Physiology 
(experimental) which was taught using the Communicator. The 
other two schools used the same units but reversed their roles. 
Plant Cells unit (experimental) was taught using the Communi- 
cator and the Animal Physiology unit (control) was taught tradi- 
tionally. Immediately following the instruction of each unit a 
test was given. The standardized test was given after the four 
units for measuring achievement gain. A test for retention was 
given three months later. 

A standardized test for students in Vocational Agriculture (de- 
veloped by Professor S. S. Sutherland, Agricultural Education 
Department, University of California at Davis) was the instru- 
ment used for the Pre-test before the units were taught. The 
Pre-test indicated the general achievement of each student in 
Agriculture’Science, and was used as an adjustment factor when 
evaluating student performance in the experiment. (By using 
these scores as control variables in the analysis of covariance, 
the possible bias introduced by individual differences is re- 
moved since these factors adequately represent the differences 
in question. ) 
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III. Instruction Schedule 



TABLE 1 



Date 


RIO VISTA 1 


ARMIJO 


VACAVILLE 


DIXON 


Sept 19 


Standardized 1 
Pre-test j 








Isept. 26 


Uontroi 1 

Animal Phys. | 








Oct. 3 


jj'amiiiari- j 

zation-Poultryl 








loct. 10 1 


Experimental^jStandardized 

Plant Cells |Pre-test 






loct. 17 1 


Barley 


Control 
Plant Cells 






Oct. 24 


Standardized | 
1 Post-test 1 


Familiari- 

zation-Barley 






joct. 31 I 




Expe rime ntciT 
Animal Phys. 


Standardized 

Pre-test 




|Nov. 7 1 




Poultry 


Control 
Animal Phvs . 




Nov. 14 




Standardized 

Post-test 


Familiari- 

zation-Barley 




Inov. 28 1 






Experimental 
Plant Cells 




Dec. 5 






Poultry 




IDec. 12 






Standardized 

Post-test 




jjan. 2 








Standardized 

Pre-test 


1 

jjan. 9 








Control 
Plant Cells 


jjan. 16 








Familiari- 

zation-Poultry 


Jan. 23 








Experimental 
Animal Phvs. 


Ijan. 30 








Barley 


Feb. 6 








standardized 

Post-test 


iRetentior 

iTests 


-| Jan. 16 


Feb. 6 


Feb. 27 


May 1 







IV. Results 
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The following table shows the results from the tests 
given iinmediately after the units were taught. 



TABLE 2 



ri 


Conditions of 
the Experiment 


Number of 

Students 

Taught 


Plant Cells and 
Animal Physiology 
Scores from all 
Four Schools 


1 Score on the 
Standardized 
Pre-test 




1 




±Y 


Y 


€X 




1! 


Experimental 


71 


2072 


29.2 


1518 


21.4 


11 


Control 

( 


69 


2247 


32.5 


1463 


21. 2 



The following table shows the results from the tests given 
3 months after the units were taught. 



TABLE 3 



Conditions of 
the Experiment 


Number of 

Students 

Taught 


Plant Cells and 
Animal Physiology 
Retention Scores 
From all Four 
Scores 


Score on the 
Standard! zee 
Pre-test 








T 




X 


Expe rimental 


70 


1769 


25. 3 


1521 


21.7 


Control 


69 


2044 


29.^ 


1481 


21. 5 















V. Discussion 



Analysis of Table 2 shows a difference of 3. 3 points be- 
tween the mean scores on the Animal Physiology and Plant Cells 
tests favoring the control group, while there is a small difference 
of only . 2 point between groups on the standardized test. Results 
from the statistical analysis provide a value which is not signifi- 
cant. 

The results from Table 3 show a difference of 4. 3 points between 
the mean scores on the Animal Physiology and Plant Cells tests 
favoring the control . There is a . 2 point difference between the 
groups on the standardized test. These results from the statis- 
tical analysis provide a value which is significant. (P = .05) 

VI. Conclusions, Implications, and Recommendations 

Under the conditions of this experiment the statistics indicate 
the following results: (1) Immediate group feed-back did not im- 

prove student learning when compared to the traditional method; 

(2) Retention of learning in the control group was significantly 
greater (P = . 05) than those in the experimental group. These 
findings were based upon the statistical method called the analysis 
of covariance; (3) The efficiency of teaching time by using the 
feed-back meters was subjectively evaluated by each of the four 
participating teachers. All agreed that this feature is a positive 
asset in determining student comprehension and in pacing the 
presentation of the lesson. Each teacher likes not only this feature, 
but the entire machine and would use it if available. Students like 
it especially, since they know their test results in minutes after 
taking the test. 

The results of the investigation and the analysis of this study by 
the instructors and consultants have brought forth some interesting 
ideas which could be the basis for further research. One area of 
interest is the differences that exist between a large and a small 
class. The use of a Communicator in a large class has been proven 
to be effective. The feed-back from a small class may not require 
an electronic device, such as the Communicator, since the teacher, 
in this situation, can usually determine his effectiveness fairly 
accurately and with little loss of time. Further research would 
be of great help in determining the effectiveness of this type of 
equipment with small classes. Perhaps also further research 
should extend for a longer period- -two or three weeks on a unit, 
rather than one week. Perhaps a population of several hundred 
or one thousand would yield better data for analysis. 
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VII. Summary 

This project was concerned with the effectiveness of feed- 
back on teaching time and on student learning in classes being 
taught agricultural principles. 

The results of the investigation showed no significant difference 
in learning between those students using feed-back equipment 
and those who were taught under traditional methods.' There 
was an indication that those receiving traditional methods of 
instruction had a higher retention of the material taught than 
those who used the feed-back equipment. 

The feed-back equipment used consisted of individual student 
response units and a master console which recorded the 
responses made by the students. A program was developed by 
four Agriculture Science teacher^ which consisted of four units 
(Animal Physiology, Plant Cells^ Barley, and Poultry). Each 
unit required one week of instruction and was immediately 
followed by a test on the material. Two of the units (Animal 
Physiology and Plant Cells) were used in the experiment and 
were scheduled into four (numbered 1, 2, 3, 4) different high 
schools. The Animal Physiology was taught in No. 1 and No. 2 
high schools using feed-back equipment. The Plant Cells unit 
was taught in No. 1 and No. 2 under traditional methods, 
(control). The No. 3 and No. 4 high schools received the same 
units except their roles were reversed, i. e.. Animal Physiology 
unit was coiUrol and the Plant Cells unit was experimental. The 
Barley and f^oultry units were used to familiarize the students 
with the equipment and to reduce the Hawthorne Effect. Because 
of initial student differences in achievement, a standardized pre- 
test in Agriculture Science was given and used in the statistical 
analysis. 

The efficiency of teaching time by using the feed-back meters 
was subjectively evaluated by each of the four participating 
teachers. All agreed that this feature is a positive asset in 
determining student comprehension and in pacing the presen- 
tation of the lesson. Each teacher likes not only this feature, 
but the entire machine and would use it if available. Students 
like it especially, since they know their test results in minutes 
after taking the test. 

It is recommended that further research be done to see if the 
equipment has an effect on small classes or very large classes 
receiving vocational instruction. 
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APPENDIX A 

I. SUMMAR Y OF STATISTICS 

A. Statistics from the test given immediately after 
instruction ’ 



Source of Variation 


df 


SSx 


SSy 


SSxy 


Syx 


MSyx(Vxy) 


1 Among 


1 


2750 


555“ 


-22 


555" 


"546^ " 


1 Within 


137 


24329 


14540 


3128 


14138 


103 



T58 2707^ ' 14940 3106 14584 



^ 446 

= T(J5 

= 4.33 



F at . 05 level = 3.91 

F at . 01 level = 6. 83 



SDyx = 10. 15 



SEn between any two adjusted means = 2. 41 

For 137 df t. 05 = 1.98 

t. 01 = 2.62 



.05 = 1. 98 X 2. 41 = 4, 77 
.01 = 2. 62 X 2.41 = 'OT 

Adjusted Means 

2571 
29.6 
“?71 



Expe r imental 
Control 







B. Statistics from the test to measure retention 



Source of Variation df SSx SSy SSxy Syx MSyx(Vxy) 



Among 


1 


3 


557” 


- 39 


bt>i 


bbi 


Within 


136 


6757 


9698 


3608 


. 9506 


69.89 



Total 



Fyx s 



1^7 5759 10356 3568 ldl6S 

662 



70 



= 9.47 



F at the . 05 level = 3. 91 
F at the . 01 level = 6. 82 



SDyx = 8. 36 



S£^ between any two adjusted means s 2. 00 



For 136 df 



t. 05 = 1.98 

t..01 s 2.62 



.05 = 2. 00 X 1.98 = 3.96 
.01 = 2. 00 X 2. 62 = 5. 24 



Experimental 


Z571 


Control 


29.6 



TTT 
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APPENDIX B 

I. F««d.back Research-Teachers' Subjective Evaluations 



A The use of the Communicator has proven to me ‘he value 
of mechanical feed-back macWnes In 

culture Science. If nothing else, the * ®any 

dents created by the Communicator would more than offset any 

of its disadvantages. 



I believe the advantages of the Communicator are as follows: 



Helps create student interest 
2 ^ jj^volves all students in lesson 

3. Long-term lesson plan time is reduce 

4. Lets teacher know immediately progress of ea 

5. Gives teacher each student's point scores daily. 



Points needing improvement: 



1. Lesson planning time--initlal lesson preparation time is 

Classroom arrangements -special classroom arrange- 
ments must be made, such as plugs in floor or external conduits, 
which make it difficult to adapt to . 

3, Student needs -- student needs_ the a - y at- ihe same 

1 Simultaneous activity-many things are at the same 

time --overlays; slides; keeping scores: question sheets must be 
c^pletety organized- -all requires lots of teacher preparation. 



V". ^4ort©ns©nj Ch3.irm3.n 
Agricultur© D©partm©nt 
Dixon High School 
Dixon, California 



B. Reaction: 



This machine was found to be valuable as a teaching aid 
if in a permanently installed installation. 



The most value of this was the immediate response to questions, 
The use of accompanying teaching aids seeme o en anc 
instruction. This operator found the carrousel projector of 
great value in interest stimulation. 



The students seemed anxious the first week and 

rapidly. With the effect of "something new worn off. the 
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second week an increased mis-use was detected. Some stu- 
dents would wait to hear the "click” of the response meter 
before answering. By having students answer on second reading 
of responses this was overcome. Many students "fumbled" with 
the keys as the lesson progressed. 



It is believed that the machine could become a useful aid if it 
could be tested for a semester of a full year. Student would then 
realize the value of the immediate response. 



Student keys could have been hidden more, as a number of stu- 
dents watched the response of others. 



As a value to an instructor, the machine was found most valuable 
in taking roll and determining percent correct responses. This 
was of value in controlling the speed of the class through the 
lesson. ® 



The evaluation of the response scores can best be evaluated by 
the author and his statistician. 



James M. Ignatieff, Teacher 
Vocational Agriculture Department 
Armijo High School 
Fairfield, California 



C. 



The use of the Communicator has a very definite place in the 
instruction of Vo-Ag Science, excepting the initial cost of equip- 
ment. 



I believe the advantages of the system are: 



1. More effective teacher- student discussion 

2. Greater motivation to the average student 

3. Teacher benefits from knowing exactly what class is think- 
ing during the period 

4. Immediate feed-back of results of questions 

5. Better instruction as a result of more time spent on lesson 
preparation. 






It would appear as though the following may be possible dis- 
advantages: 



1. Instruction is largely teacher centered 

2. Some students may have a greater chance to cheat due to 
technique of asking questions 
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3. Cost per student is quite high 

■ method"!uytt' 

Larry Rathbun 
Director of Agriculture 
Rio Vista Joint Union High School 
Rio Vista, California 

D. It is my firm opinion that the use of the Communicator 
ching machine is considerably more valuable in f-oa u- 
learning and retention than this brief study ind®ca"es *’ 

school districro Jifone. 

Its strongest points, in my opinion, are: 

2 feed-back to both students and teacher 

2. Motivation of student interest 

wirk and"e7ts" =1— 

required!**’' P'®Pared instructional material is 

Other significant points are: 

tion oi unUrt^'te'tai'ghT - P-P«- 

same frame or Projection,' ™ 

'”“r 



Twyman G. Williams, Jr. 
Chairman 

Agriculture Department 
Vacaville High School 
Vacaville, California 
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